RELIABLE SYMBOLS AS A MEANS OF IMPROVING THE PERFORMANCE OF 



INFORMATION TRANSMISSION SYSTEMS 



BACKGROUND 

The present invention relates to a data processing technique that permits 
identification of reliable symbols in the presence of Inter-Symbol Interference ("ISI") and 
q|Y er data correlated noise (collectively, "ISI")- Data correlated noise refers to a variety 

o] 

(^phenomena in data processing systems in which a data signal interferes with itself at a 
estination. The present invention also relates to the use of reliable symbols to 
determine values of source symbols that are corrupted by ISI. The present invention 
finds application in systems where source symbols are members of high-order 
constellations. Previously, such systems have required the use of training symbols for 
operation in the presence of real-world ISI phenomenon. 

FIG. 1 illustrates an exemplary data processing system 100 in which ISI may 
occur. A source 110 may generate a data signal X (herein, a "source data signal"). 
When delivered to a destination 120 as a received signal Y, the source data signal X may 
be corrupted by ISI sources 130. For example, multiple copies of a single data signal X 
may be captured at the destination 120, each copy being received with an unknown time 
shift and gain with respect to the other copies. Further, the time shifts and gains may 
vary over time. 

ISI phenomena may be modeled mathematically. In the case where the data 
signal X is populated by a number of data symbols x n , captured signals y n at the 

destination 120 may be represented as: 

Yn = a 0 * x n +f ( x n-K 1 »* , ^ x n-l» x n+l» , "» x n+K 2 ) + ^n- (1) 

where ao represents a gain factor associated with the channel 130, f(x n _Kj»- x n+K 2 ) ' s a 
functional representation that relates the ISI to the symbols, x n _ Ki ,...x n+K2 , causing ISI 
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corruption and co n represents corruption from other sources. In linear systems, Eq. 1 may 
reduce to: 

K 2 

yn=X n + Zai*Xn-i+^n ( 2 ) 

where a. K ,...a K represent the sampled values of the impulse response of the channel. In 

accordance to common practice, the values a; have been normalized by the value of ao in 
Eq. 2. 

[5] ISI may arise from a variety of real-world phenomena. Multipath is an example of 

ISI that occurs in wireless and other communication systems. In a wireless system 200, 
shown in FIG. 2, a base station 210 may transmit data addressed to a mobile station 
220 over a region of space, typically a cell or a cell sector. The mobile station 220 may 
receive the signal via a direct line-of-sight path and also may receive copies of the data 
signal via other indirect paths. The indirect paths may be caused by reflections of the 
transmitted signal from structures in the transmission environment such as buildings, 
trucks, mountains and the like. At the mobile station 200, the directly received and 
indirectly received signals interfere with each other. The indirect transmissions, 
however, because they travel a longer propagation path before they reach the mobile 
station, are delayed with respect to the direct path signal. 

[6] ISI is seen as a serious impediment to the use of high-order constellations for data 

processing systems. A "constellation" represents a set of unique values that may be 
assigned to data symbols. Several examples are shown in FIG. 3. FIGS. 3 (a)-(c) 
illustrate constellations for amplitude shift keying ("ASK") applications where symbols 
can take one of four, eight or sixteen unique values. When compared to a binary symbol 
constellation, use of these constellations yields data throughput increases by factors of 2 
(four levels), 3 (eight levels) or 4 (sixteen levels). FIGS. 3 (d)-(f) illustrate constellations 
for quadrature amplitude modulation ("QAM") applications where symbols can take one 
of four, sixteen or sixty-four unique values. When compared to a binary symbol 
constellation, use of these constellations yield data throughput increases of 2 (four 
levels), 4 (sixteen levels) and 6 (sixty-four levels). Thus, use of high-order constellations 
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in data processing systems can yield increased throughput over binary systems within 
the same bandwidth. 

[7] The problem is that, when using high-order constellations, blind equalization 

(equalization without either an initial training sequence, or 'refresher' training 
sequences) is very hard to achieve because the detrimental effects of ISI increase with 
increasing constellation order. 

[8] There is a need in the art for a data transmission system that, in the presence of 

realistic levels of ISI, uses blind techniques to decode symbols from a high-order 
constellation. 

[9] BRIEF DESCRIPTION OF THE DRAWINGS 

[10] FIG. 1 illustrates an exemplary data processing system in which ISI may occur. 

[11] FIG. 2 illustrates an exemplary communication system in which ISI may occur due 

to multipath. 

[12] FIG. 3 illustrates various symbol constellations. 

[13] [FIG. 4 illustrates a method of operation for detecting reliable symbols according 

to an embodiment of the present invention. 

[14] FIG. 5 illustrates a method of operation for detecting reliable symbols according 

to an embodiment of the present invention.] 

[15] FIG. 6 illustrates another method of operation 3000 for detecting reliable symbols 

[16] [FIG. 7 is a block diagram of a data decoder according to an embodiment of the 

present invention. 

[17] FIG. 8 illustrates a data decoding method of operation according to an 

embodiment of the present invention. 
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[18] 



FIG. 9 is a block diagram of a data decoder according to another embodiment of 
the present invention. 



[19] 



FIG. 10 is a block diagram of a receiver structure according to an embodiment of 
the present invention.] 



[20] 



DETAILED DESCRIPTION 



[21] 



Embodiments of the present invention identify reliable symbols from a sequence 



of captured signal samples at a destination. Although the ISI effects associated with 
high-order symbol constellation transmissions impose large signal corruption on average, 
some samples suffer relatively low levels of ISI. These samples are the reliable symbols. 
Having identified reliable symbols from a sequence of captured signal samples, it is 
possible to reliably estimate the actual source symbols for all captured signal samples. 

[22] Identification Of Reliable Symbols 

[23] A "reliable symbol" is a captured sample y n that is very likely to be located within 

a decision region of a corresponding source symbol x n transmitted from the source 110 
at time n. At a destination 120, each constellation symbol is associated with a decision 
region that represents a set of all points that are closer to the respective symbol than to 
any other symbol in the constellation. FIG. 3(e) shows exemplary decision regions 140, 
150 for symbols -1,-1 and 1,3 in the 16-level QAM constellation. For a reliable symbol, 
the combined ISI and additive noise effects and other channel and system impairments 
are unlikely to have pushed the captured sample y n from a decision region of the symbol 
x n from which it originated. 

[24] [According to an embodiment of the present invention, identification of a signal y n 

as "reliable" may be carried out using a reliability factor R n given by; 



where the Cj are constants representing any priori knowledge of the ISI effect that may be 
available. Generally, if nothing is known about the ISI, then the q's may all be set equal 




(3) 
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to 1. In other situations, additional information as to the nature of the channel 130 may 
be known and the Cj's may be given values reflecting this information. If the reliability 
factor of a sample y n is less than a predetermined limit value, designated "dn m " herein, 
the sample may be designated as a "reliable symbol." 

[25] Where samples on only one side of a candidate sample y n contribute to the ISI, 

the reliability factor of the sample y n may be determined using: 

Rn = l|y n -iK. (4) 
i=l 

where K=f<2 in equation (2). In respect to the forgoing reliability factors (equations (3) 
and (4)) the y n 's may be real for one-dimensional signal structures or complex for two- 
dimensional signal structures. 

[26] For systems using two-dimensional constellations, such as the QAM constellations 

shown in FIG. 3(d)-(f), the reliability factor may be determined using: 

R n= s Jyf.+y! . - c i < 5 > 

where yf and y~ respectively represent values of y n .j in the first and second 
dimensions. 

[27] FIG. 4 is a flow diagram of a reliable symbol detection method 1000 according to 

an embodiment of the present invention. According to the method, reliable symbol 
detection may begin by calculating a reliability factor of a sample y n based on values of 
neighboring samples (box 1010). Thereafter, the method may determine whether the 
reliability factor is less than or equal to a predetermined threshold (box 1020). If so, the 
sample y n may be designated as a reliable symbol (box 1030). Otherwise, the sample y n 
is not reliable. 

[28] The predetermined threshold d|j m may be determined based on the applications 

for which the identification method is to be used. In one embodiment, the threshold may 
be set to the value d|j m =(Ki +K 2 )*d mjn where dmm is half the distance between two 
constellation points that are closest together. This threshold is appropriate for the case 
379683_i.doc Page 5 of 30 ii927/46ooi 



where - — r £|aj|<l. Experiments have shown, however, that operation can be maintained 
| a o| i=-K a 

1 K 2 

using the same threshold when - — r Xhl ^14. 

Pom — k, 

[29] The threshold d| im also may vary over time. If the predetermined threshold is 

increased, then an increased number of samples will be accepted as reliable symbols 
though, of course, all of these symbols will not be of the same reliability. Similarly, by 
decreasing the threshold dlim, the number of samples that are designated as reliable 
symbols will decrease. These symbols will be those symbols with lower reliability 
factors. During operations of a reliable symbol detection method, the threshold d|j m may 
be varied to maintain a rate of detected reliable symbols at a desired value. For 
example, if a rate of detected symbols falls below a first rate threshold, the d|j m value 
may be increased. Or, if the rate of detected symbols exceeds a second rate threshold, 
the diim value may be decreased. 

[30] FIG. 5 is a flow diagram of a method of operation 2000 to determine whether a 

candidate sample y n is a reliable symbol. For operation of the method, an index variable i 
may be set to -Ki and a reliability counter R n may be set to zero (R n =0) (box 2010). The 
method may begin by adding to reliability counter R n the value of a sample y n .j 
(R n =R n +|y n .i |) (box 2020). Thereafter, if the reliability counter R n exceeds a 
predetermined limit (box 2030), the candidate symbol may be disqualified as a reliable 
symbol (box 2040). In this case, operation of the method 2000 may cease for the 
candidate sample y n . 

[31] If at box 2030 the reliability counter R n does not exceed the predetermined limit, 

the method may continue. The index value i may be incremented (box 2050). If i=0, if 
n-i points to the candidate symbol y n itself (box 2060), the index value may be 
incremented again. Otherwise, the method 2000 may determine whether i is greater 
than K 2 (box 2070). If so, then the candidate sample y n is a reliable symbol (box 2080). 
Otherwise, the method may return to the operation at box 2020 and add to the reliability 
counter based on the value of the next sample y n .j. 
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[32] The foregoing description of the method 2000 has presented operation when no a 

priori knowledge of the channel is available at the destination 120 (e.g., Cj=l for all i). 
When knowledge of the channel is available and Cj values may be determined for one or 
more i, then at box 2020 the reliability counter R n may increment according to 
R n =R n +Cj»|y n .j| (shown as bracketed text in box 2020). 

[33] In this way, the method of operation 2000 examines the neighboring samples of y n 

(Ki precursors and K2 postcursors) to see if y n meets the criterion for being a reliable 
symbol. 

[34] When a destination captures a plurality of samples y n , each sample may be 

considered according to the method of FIG. 5 to determine whether the sample is a 
reliable symbol. Operation of the method 2000 can be accelerated in certain 
embodiments. If, for example, a sample, say yj, by itself exceeds the reliability threshold 
then none of the neighboring symbols y iF i=j-Ki to j+K 2 , can be reliable symbols. In this 
case, the method 2000 need not be operated upon these neighboring symbols. The 
procedure can advance by skipping ahead to examine the first sample y n that does not 
include yj in its group of surrounding samples. In this embodiment, although the value of 
yj may disqualify neighboring samples from being reliable symbols, yj itself may be a 
reliable symbol. The method 2000 may operate on yj to determine whether it is a 
reliable symbol. 

[35] Additionally, the surrounding samples may be selected, as a sub-set of the full 

range i= -Ki to K2 and the associated surrounding symbols be examined. If a sequence 
of, say, three symbols yj to yj+2 have values that would cause the reliability limit dnm to be 
exceeded, then any symbol y\ having the sequence of symbols within the -Ki to K2 window 
need not be considered under the method 2000 of FIG. 5. 

[36] An alternate embodiment finds application where ISI corruption is expected to be 

linear and caused by symbols from only one side of a candidate symbol, according to: 

K 2 

Yn =x n + Zai-x n -i+^n (6) 
i=l 
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In such an embodiment, the iterative scan illustrated in FIG. 5 may simplify since K x is 
equal to zero.] 

[37] FIG. 6 illustrates another method of operation 3000 for detecting reliable symbols 

when ISI effects are expected to be linear and no knowledge of the coefficients Cj is 
available. The method 3000 may initialize an index value i to -Ki (box 3010). The 
method may determine whether the absolute value of a symbol y n .j occurs within a 
predetermined limit (box 3020). If not, the method terminate for candidate symbol y n ; it 
will not be designated as a reliable symbol (box 3030). If the value of y n .j does occur 
within the predetermined limit, however, the method may increment i (box 3040). 
Thereafter, the method may determine whether i=0 (box 3050). If so, the method may 
return to box 3040 an increment i again. Thereafter, the method may determine whether 
i>K2 (box 3060). If so, the sample y n may be designated as a reliable symbol (box 
3070). If not, the method may return to box 3020 for testing of other samples. 

[38] In QAM systems, there are several alternatives to detect reliable symbols. As 

shown in FIGS. 3 (d)-(f), QAM constellation points may be mapped as a two-dimensional 
coordinate space of in-phase data ("I") and quadrature-phase data ("Q"). In the simplest 
embodiment, where ISI is known to corrupt I data and Q data independently of each 
other, reliability factors may be established independently for I and Q data. That is, any 
of the methods of FIG. 6 may be performed for independently I and Q data. A sample's 
reliability may be calculated for the Q domain without regard for the sample's I value and 
also calculated for the I domain without regard for the sample's Q value. It may occur 
that a symbol will be considered reliable for I but not for Q or vice versa. This is 
appropriate since this technique is to be used in circumstances where it is known that 
the ISI in each domain are independent. 

[39] The method of FIG. 6 finds application in other embodiments where ISI is not 

known to be real. In such a case, the predetermined limit may be based on rectangular 
"rings" of the constellation. With reference to FIG. 3(f), for example, a first constellation 
ring may include the set of (l,Q) constellation points: 1,1, 1,-1, -1,-1 and -1,-1 (shown as 
160 in FIG 3 (f)). A second constellation ring may include the set of constellation points: 
3,3, 3,1, 3,-1, 3,-3, 1,-3, -1,-3, -3,-3, -3,-1, -3,1, -3,3, -1,3 and 1,3 (shown as 170 in FIG 3 
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(f)). Higher order constellations may have additional rings. In this embodiment, the 
method determines whether values of the samples y n .j occur within a predetermined 
rectangular ring or any lower-order ring. 

[40] Alternatively, reliable symbols may be identified according to one or more of the 

techniques described in the Applicant's co-pending PCT patent application 
PCT/GB00/02634, entitled "Adaptive Blind Equaliser," filed 10 th July 2000, the subject 
matter of which is incorporated herein by reference. 

[41] The foregoing discussion has described various embodiments for identification of 

reliable symbols in a captured signal stream. Reliable symbols may be decoded 
immediately without further processing. Thus, for the set Y RS of reliable symbols, 
y n eY RS , a data decoder in a destination 120 may generate decoded symbols x n to be the 
constellation point closest to y n . The decoded symbol x n may be the destination's 
estimate of the source data symbol x n . 

[42] [The foregoing embodiments find application in applications in which captured 

samples y n do not exhibit phase offset with respect to the source symbols x n . Of course, 
in some applications, it may be expected that the captured samples y n will exhibit a 
phase offset with respect to their source symbols x n . Where captured samples y n exhibit 
a phase rotation with respect to the source symbols x n , a "reliable symbol" may be 
defined alternately as a sample y n that is likely to be observed in the annular 
constellation ring of its source symbol x n . Restated, ISI corruption is unlikely to push the 
source symbol x n from its constellation ring when observed as the captured sample y n at 
the destination 120. The reliability factor of equation 3 may be applied in this 
embodiment, using observed power levels of the captured samples: 

K 2 

R n = EPoweKyn.O-Cj , (7) 
1*0 

and, when the signal is complex, equation 5 may be used. 

[43] Exemplary annular constellation rings are shown in FIG. 3(g). For any given 

symbol point (such as point (1,5)) there will be a plurality of symbols having the same 
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distance from the constellation center. These symbols define a circle 180. Other 
constellation symbols define other circles, such as 190-1 and 190-2 in FIG. 3(g). Each 
circle defines a constellation ring (not shown) that includes all points in the constellation 
space that are closer to the circle than to any other circle in the constellation. 

[44] The methods of FIGS. 4 and 5 may find application when captured samples y n 

exhibit phase offset with respect to their source symbols x n . In this case, the threshold 
diim may be set according to half the width of the annular constellation ring in which the 
captured sample y n is observed. 

[45] In one embodiment a subset of the total range of power levels of y n may be used. 

[46] Use Of Reliable Symbols 

[47] In further embodiments of the present invention, reliable symbols may be used as 

a basis for decoding transmitted symbols x n from received non-reliable captured samples 
that are not reliable symbols (y n £YRs). A description of these embodiments follows. 

[48] FIG. 7 is a block diagram of a data decoder 300 according to an embodiment of 

the present invention. The data decoder 300 may include a reliable symbol detector 310, 
an adaptation unit 320 and a symbol decoder 330. The reliable symbol detector 310 
may identify a plurality of reliable symbols yRseY RS from a sequence of captured 

samples y n . The reliable symbol detector 310 may output the reliable symbols yRs and 
their surrounding samples (labeled y\ in FIG. 7) to the adaptation unit 320. Based upon 
yRs and yi, the adaptation unit 320 may generate ISI metrics that characterize the ISI 
signal corruption 130 (FIG 1). The adaptation unit 320 may output to the symbol 
decoder 330 data Misi representing the ISI metrics. Based upon the ISI metrics, M| S i, the 
symbol decoder 330 may generate decoded symbols x n from the captured samples y n , 

for all n, regardless of whether the sample y n is a reliable symbol or not. 

[49] FIG. 8 illustrates a data decoding method 3000 according to an embodiment of 

the present invention. According to the method, a data decoder may identify a set of 
reliable symbols Y RS from a sequence Y of captured samples (Step 3010). Using this set 
of reliable symbols Yrs and their neighbors, the data decoder may estimate an ISI metric 
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(Step 3020). Thereafter, using the ISI metric, the data decoder may decode symbols x n 
from the sequence Y of captured samples (Step 3030). 

[50] Adaptation and symbol correction techniques per se are known. In 

communication applications, such techniques often are provided within channel 
equalizers. A variety of channel equalization techniques are known, including both time- 
domain equalizers and frequency-domain equalizers. At a high level, adaptation refers to 
the process by which the equalizer learns of the ISI corruption effects and symbol 
correction refers to a process by which the equalizer reverses the ISI effects to determine 
from the sequence of captured samples Y what the source symbol sequence X is most 
likely. However, for these existing techniques to work, in the presence of realistic level of 
ISI when operating with high-order constellations, it would be necessary to use an 
initializing training sequence and thereafter to use training sequences that are 
transmitted periodically. The use of the reliable symbols method overcomes this need. 
Any of a variety of known equalizers may be used with the reliable symbols technique 
and the adaptation process -- the process by which the equalizer learns - can be 
rendered blind. Having learned what the ISI effects are based on the reliable symbols 
yR$, the equalizer may decode symbols x n from all of the captured samples y n . 

[51] Perhaps the simplest embodiment of equalizer is the subtractive equalizer. In the 

subtractive equalizer, the adaptation unit 320 estimates the channel ISI coefficients a ja 

Using the estimated coefficients a ; the symbol decoder 330 may estimate source 
symbols, x n , by decoding y„ where: 

K 2 

y'n =yn-Zai-x n -i ( 8 ) 

in which x n _j represent prior decoded symbols. The equalizer may generate a decoded 
symbol x n as the constellation symbol that is closest to y' n . 

[52] As noted, different types of equalizers can be used. A decision feedback equalizer 

(also "DFE") may be incorporated within the symbol decoder 410 of the system 400 
shown in FIG. 9. Conventionally a DFE is fed with information obtained from training 
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sequences. In an embodiment employing reliable symbols, information may be fed to the 
adaptation unit 420. The adaptation unit 420 may update the tap settings of the DFE. 

[53] In this embodiment shown in FIG. 9, the reliable symbol detector 430 may 

identify reliable symbols from the captured samples y n . An output of the reliable symbol 
detector 430 may be an enabling input to the adaptation unit 420. When a reliable 
symbol is identified, the adaptation unit 420 may be enabled, causing it to revise its 
estimate of the ISI metrics Misi- ] 

[54] The foregoing embodiments have described use of reliable symbols to extend 

application of known adaptation processes to ISI estimation for high-order constellations 
in the presence of realistic levels of ISI without the use of training sequences. By 
extension, this use of reliable symbols permits data decoders to estimate high- 
constellation source symbols X from a sequence Y of captured samples. Advantageously, 
this use of reliable symbols may be made non-invasive in that it can be employed without 
changing known adaptation and symbol decoding processes in prior art equalization 
systems. 

[55] Estimation of Channel Coefficients Based on Reliable Symbols and Reliability 

[56] By way of illustration, a way in which reliable symbols can be used in ISI 

coefficient estimation will now be described briefly. Consider the estimation of one- 
dimensional ISI coefficients. After a sufficient number of reliable and their related 
surrounding samples have been identified, the estimation of the ISI coefficients may be 
obtained as the solution of a standard matrix equation: 

a=(H T H) _1 H T J (9) 
where: a is a vector of the ISI coefficient estimates; H is an NxM matrix, with N>M, in 
which each row contains the M surrounding symbol estimates or alternatively, the 
corresponding M surrounding sample values for each reliable symbol, and N is the 
number of related detected reliable symbols (a larger N is required for lower signal to 
noise ratios); and 8 is an N x 1 vector that contains the distances of the N reliable 
symbols from their estimated origin points. 
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By way of example, consider the following situation: The ISI length is assumed to 
have two coefficients (K 1 =0,K 2 =2) and the estimation is based on four reliable 
symbols. Let it be assumed that they correspond to time indexes: 100, 250, 300 and 
320. Then, 



(10) 
(11) 



I = {yiOO - *ioo» y250 - *250> y300 - *300> Y320 ~ *320 } T 

H== X 2 48,X 2 49 
X 298**299 
^318^319, 

[Optionally, however, the performance of the ISI adaptation can be improved by 
integrating a reliability weight factor into the calculation of ISI metrics. Consider the 
case of a subtractive equalizer. In such an equalizer, an adaptation unit 320 may 
estimate channel coefficients a, and generate an estimate of source symbols according to 
Eq. 9 above. ] 

In an embodiment, an estimate a of a may include a weighting based on 

reliabilities associated with received signal values. In this embodiment an estimate a of 
a may proceed according to: 



a = ^ T ^)" 1 H T W^ 



(12) 



where $ is a diagonal NxN matrix of reliability weights Wjj (w^ =0 for all /*/). [In one 
such embodiment, the reliability weights w itj may be obtained as: 

Wi,i=f(Ri) (13) 
where /?, is the reliability factor associated with an / th sample value, / being a member of 
the set of N sample values being used in the estimation process, and /(.) is a function 
that increases inversely with the associated reliability factor (e.g. as defined in equation 
3). 

Thus, symbols of varying degrees of reliability can be used with an appropriate 
reliability weighting. ] 
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[59] In an embodiment, a destination may store captured samples in a buffer memory 

while reliable symbols are detected and while ISI estimation occurs. Thereafter, when 
the ISI metrics are available, the stored samples may be read from the memory and 
decoded. In this regard, provided the buffer memory is appropriately sized, all captured 
samples may be decoded. 

[60] Estimation of Constellation Symbols In View of Channel Gain 

[61] Channel gain (ao in equation 1) can be a major parameter to be estimated in 

channel equalizers. To facilitate the foregoing discussion, coefficients a; are presented as 
normalized to the value of ao- Doing so permits the presentation to discuss the 
constellation diagrams of FIG. 3 as being identically-sized at both the source 110 and the 
destination 120. In practice, unless the channel gain is a known predetermined quantity, 
the destination 120 may estimate the channel gain ao and, from this estimation, assign 
the samples y n to constellation decision regions. 

[62] The foregoing embodiments of reliable symbol detection find application in 

systems that may use conventional channel gain estimation techniques. Channel gain 
estimation may be improved, however, through use of reliable symbols. Accordingly, the 
following discussion presents use of reliable symbols to determine channel gain. The 
discussion assumes that ISI coefficients a; are unknown. 

[63] Communication through an ISI channel may cause captured samples to be 

observed having values that exceed the extreme points of a transmitted constellation. In 
fact, the samples could reach as far as l + Z|ISIj| times the maximum transmitted 

i 

symbols. In the absence of carrier phase offset, reliable symbols are those captured 
samples y n that are very likely to be located in a decision region of their source symbols 
x n . 

[64] According to an embodiment, a destination may identify a predetermined number 

of reliable symbols from the captured samples. Initially, those reliable symbols that have 
the maximum magnitude in each constellation axis may be set to the initial maximum 
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constellation point in each axis. Let P max be the initial estimation of the maximum 
constellation point, then: 

pi 

P 1 = sign(i). m ^ (2|i| - 1) (14) 

Vconstellation -1 

may be used as an estimation of the remaining constellation points in each axis, where i 
is an index traversing the number of constellation points in each axis direction and 
constellation represents the number of constellation points in the constellation. For 
irregular constellations, the calculation may be performed independently for each axis j 
in the constellation. For example, in QAM systems je[l,Q]. In this case, equation 14 may 

become: 

P 1 

P^signfl). maXi (2|i|-l) (15) 
' ^axiSj -1 

where axiSj represents the number of constellation points in the respective axis of the 
constellation. 

While the error in the maximum estimated points can be up to one unit, for points 
that are closer to zero the upper limit on the error goes down to, 

lerrorl . < . 1 : P/.i (16) 

1 ,mm Vconstellation ' 

for the points with the smallest magnitude. 

Thereafter, the constellation points may be estimated. For the i th constellation 
point P\: 

= (2|i| - 1).?/ (17) 

when, 

Pi^Pi'-Pi- (18) 
Let the reliable symbol y' n be expressed by the origin point plus the related ISI noise 
coefficient d' n . From equations 16, 17 and 18: 

y'n =p. +<il ^pi 1 -n 1 + * ^ps 1 D.Pi 1 H-dj, (i9) 
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where n is the index of the reliable symbol and i the index of the related constellation 
point. The ISI noise, d' n can be modeled as a zero mean, almost gaussian distribution 
parameter that does not depend upon i. Using a weighted average estimator over P^-yd 
where {y} is a subset s of the reliable symbols: 



(20) 



and where the expectation of P lf is: 



= E 



1 



2|i|-l 



EI?*" 1 " 



= E 



■E(d n ) 



2|i| 

= P 1 1 -P 1 = P 1 1 



(21) 



then, 



Pi = Pj 1 + (2|i| - 1) - P 2 (22) 

where ^ are the final estimation of the constellation points. The estimation in equation 

20 may be done on the first estimation error. Equation 21 indicates that the estimation 
in 20 is not biased. 

[FIG. 10 is a block diagram of a receiver structure 500 according to an 
embodiment of the present invention. The receiver 500 may include a demodulator 510, 
a memory 520 and a processor 530. FIG. 10 illustrates communication flow among the 
demodulator 510, the memory 520 and the processor 530, not actual electrical 
interconnections among these units. 

The demodulator 510 captures a signal Y from the channel and generates 
captured samples y n therefrom. The channel may be an electric, magnetic, acoustic, or 
optical propagation medium. Demodulators 510 for capturing such signals are well- 
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known. On account of the ISI, samples from the captured signal stream generally will 
have no detectable correspondence to the transmitted constellation. It may take any 
number of values between the constellation points (e.g. 6.3, 6.5, -3.1). Captured sample 
data may be stored in a buffer 522 in the memory 520. 

[69] The memory system 520 may be logically organized to perform storage functions 

that may be necessary for operation of the structure 500 as an equalizer. A first area 
522 of the memory may store captured samples y' n for further processing. This area 
may double as the frame memory 250 and buffer 270 illustrated in FIG. 2. A second 
area 524 of the memory may store the decoded symbols d n . And, of course, a third area 
of memory 526 may store program instructions. The memory system 520 may be 
populated by electric, magnetic or optical memories or other storage elements which 
may be configured as a read-only memory (ROM) or random access memory (RAM). 

[70] As dictated by the instructions, operation of the processor 530 may be divided 

into logical units such as a reliable symbol detector 532, an adaptation unit 534 and a 
symbol decoder 536. The processor 530 may be a general purpose processor, a digital 
signal processor, an application-specific integrated circuit or a collection of processing 
elements. The processor 530 may generate data representing estimated source symbols 
x n . These estimated source symbols may be output from the receiver structure 500 or, 

in an alternate embodiment, be returned to the memory 520 in a decoded symbol buffer 
524 to await further processing, or both.] 

[71] The foregoing discussion has presented techniques for identifying, from a 

sequence of captured samples, reliable symbols - samples that are likely to remain 
within the decision region of source symbols notwithstanding the presence of ISI 
corruption. Further, various data decoding techniques have been presented that permit 
ISI estimation to be carried out based on the identified reliable symbols and, therefore, 
permits decoding of all captured samples to occur. Additionally, the reliable symbol 
techniques permit equalization to occur as a "blind" process, without requiring use of 
training symbols to estimate the channel effect. The inventors have simulated 
transmission using 64-level QAM, 256-level QAM and 4096-level QAM. Use of these 
transmission constellations provides a 3 to 6-fold increase respectively in data 
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transmission rates over 4-level QAM. Thus, the present invention contributes to data 
transmission systems having increased throughput without incurring expense in 
communication bandwidth. 

Although the foregoing discussion refers to intersymbol interference as a source of 
data corruption affecting a source signal X, application of the present invention is not so 
limited. The present invention finds application in any situation in which data correlated 
noise occurs. References herein to "1ST should be so construed. 

Several embodiments of the present invention are specifically illustrated and 
described herein. However, it will be appreciated that modifications and variations of the 
present invention are covered by the above teachings and within the purview of the 
appended claims without departing from the spirit and intended scope of the invention. 



r 
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WE CLAIM: 



1. [A reliable symbol identification method comprising: 

calculating a reliability factor of a candidate sample from values of a plurality of 
samples in proximity to the candidate sample, 

if the reliability factor is less than a predetermined limit, designating the 
candidate sample as a reliable symbol. 

2. The method of claim 1, wherein the reliability factor R n of the candidate sample is 
given by: 

K 2 

R n = XlYn-iK, where 

i=-K 1 

y n is the candidate sample, 

y n .j is a sample in proximity to the candidate sample, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 

q is a coefficient. 

3. The method of claim 2, where Cj = 1 for all i. 

4. The method of claim 2, wherein Ki = 0. 

5. The method of claim 2, wherein K2 = 0. 

6. The method of claim 1, wherein the predetermined threshold varies over time. 

7. The method of claim 1, further comprising determining a rate at which reliable 
symbols are identified, and 

if the rate is less than a predetermined value, increasing the predetermined 
threshold. 

8. The method of claim 1, further comprising determining a rate at which reliable 
symbols are identified, and 
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if the rate exceeds a second predetermined value, decreasing the predetermined 
threshold. 



9. The method of claim 1, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 



y? and yi respectively represent values of a neighboring sample y n .j in first 

■^n-i ^n-i 

and second dimensions, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 
d is a coefficient. 

10. A method of identifying reliable symbols, comprising, for a candidate sample y n : 
iteratively, for i= -Ki to K 2 , i*0: 

adding to a reliability factor based on a value of the sample y n .j, 

if the reliability factor exceeds a predetermined limit, disqualifying the 

candidate sample as a reliable symbol, and 

otherwise, incrementing i and, if i=0, re-incrementing i for a subsequent 

iteration; 

thereafter, unless the candidate symbol has been disqualified, designating the 
candidate sample as a reliable symbol. 

11. The method of claim 11, wherein the adding adds an absolute value of the sample 
y n .i to the reliability factor. 

12. The method of claim 11, wherein the adding adds a scaled value of the sample y n .j 
to the reliability factor, the value scaled in accordance with a predetermined coefficient 

Cj. 

13. The method of claim 11, wherein the adding adds the power of the sample y n .j to 
the reliability factor. 

14. The method of claim 13, wherein the predetermined limit is half a width of an 
annular constellation ring in which the candidate sample is observed. 
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15. The method of claim 11, the predetermined limit is (K 2 +K 2 )d rri j n where d m in is half 
a distance between two constellation points that are closest together in a governing 
constellation. 

16. The method of claim 11, wherein the predetermined limit varies over time. 

17. The method of claim 11, further comprising determining a rate at which reliable 
symbols are identified, and 

if the rate is less than a predetermined value, increasing the predetermined limit. 

18. The method of claim 11, further comprising determining a rate at which reliable 
symbols are identified, and 

if the rate exceeds a second predetermined value, decreasing the predetermined 

limit.] 

19. A method of identifying reliable symbols, comprising, for a candidate sample, 
determining whether any of a plurality of neighboring sample values is within a 

predetermined limit, 

if none of the values exceed the threshold, designating the candidate sample as a 
reliable symbol. 

20. [The method of claim 19, wherein the predetermined limit varies over time. 

21. The method of claim 19, further comprising determining a rate at which reliable 
symbols are identified, 

if the rate is less than a predetermined threshold, increasing the predetermined 

limit. 

22. The method of claim 21, further comprising, if the rate exceeds a second 
predetermined threshold, decreasing the predetermined limit. 

23. The method of claim 19, wherein the neighboring samples occur in a first window 
adjacent to the candidate sample on one side of the candidate sample.] 
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24. The method of claim 19, wherein the neighboring symbols occur in a pair of 
windows that are adjacent to, and on either side of the candidate sample. 

25. A reliable symbol detection method, comprising: 

identifying a sequence of signal values having values within a predetermined limit, 

and 

designating a sample adjacent to the sequence as a reliable symbol. 

26. [The method of claim 25, wherein the predetermined limit varies over time. 

27. The method of claim 25, further comprising determining a rate at which reliable 
symbols are identified, 

if the rate is less than a predetermined threshold, increasing the predetermined 

limit. 

28. The method of claim 27, further comprising, if the rate exceeds a second 
predetermined threshold, decreasing the predetermined limit. 

29. A data decoder comprising: 

a reliable symbol detector to detect reliable symbols from a sequence of captured 
samples, the captured samples having been corrupted by at least intersymbol 
interference ("ISI"), 

an adaptation unit coupled to the reliable symbol detector to generate ISI metrics 
based on the reliable symbols, and 

a data decoder to receive the captured samples and estimate source symbols 
based on the ISI metrics. 

30. An equalization method, comprising 

identifying reliable symbols from a string of captured samples, 
calculating channel effects based on the reliable symbols and samples adjacent 
thereto, 

correcting the captured samples based on the channel effects. 

31. The method of claim 30, wherein the identifying comprises: 
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calculating a reliability factor of a candidate sample from values of a plurality of 
samples in the neighborhood of the candidate sample, 

if the reliability factor is below a predetermined limit, designating the candidate 
sample as a reliable symbol. 

32. The method of claim 31, wherein the reliability factor of the candidate sample y n 



y n .j is a sample in the neighborhood of the candidate sample, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 

d is a coefficient. 

33. The method of claim 31, wherein the reliability factor of the candidate sample y n 
is given by: 



y n .j is a sample in the neighborhood of the candidate sample, 
K is a length of samples, and 
Cj is a coefficient. 

34. The method of claim 31, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 



y? and y? respectively represent values of a neighboring sample y n .j in first 

and second dimensions, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 
Cj is a coefficient. 

35. The method of claim 30, wherein the identifying comprises: 
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is given by: 



K 2 

R n = Z|y n -i|-Cj , where 





identifying a sequence of samples having received signal magnitude levels below a 
predetermined limit, and 

designating a sample adjacent to the sequence as a reliable symbol. 

36. The method of claim 30, wherein, for QAM transmission, the identifying 
comprises: 

identifying a sequence of samples for which a received signal magnitude in a 
quadrature-phase component is below a predetermined limit, and 

designating an adjacent sample as a reliable symbol for quadrature-phase. 

37. The method of claim 30, wherein, for QAM transmission, the identifying 
comprises: 

identifying a sequence of samples for which a received signal magnitude in an in- 
phase component is below a predetermined limit, and 

designating an adjacent sample as a reliable symbol for in-phase. 

38. The method of claim 30, wherein the calculating estimates K channel coefficients 

K 

a; according to a least squared error analysis of y RS -x n - Za^n-i » solving for aj, for a 

i=l 

plurality of reliable symbols yRs, where x n and x n _j are estimated transmitted symbols. 

39. The method of claim 30, further comprising assigning weights among the reliable 
symbols based upon respective reliability factors. 

40. An equalizer, comprising: 
a buffer memory, 

a reliable symbol detector in communication with the buffer memory, 
an adaptation unit in communication with the reliable symbol detector, and 
a symbol decoder in communication with the adaptation unit and the buffer 
memory. 

41. The equalizer of claim 40, wherein the reliable symbol operates according to a 
method, comprising: 
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calculating a reliability factor of a candidate sample from values of a plurality of 
samples proximate to the candidate sample, and 

if the reliability factor is less than a predetermined limit, designating the 
candidate sample as a reliable symbol. 

42. The equalizer of claim 41, wherein the reliability factor R n of the candidate sample 
is given by: 

K 2 

R n = E|y n -i|*Ci , where 

y n is the candidate sample, 

y n .j is a sample in proximity to the candidate sample, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 

q is a coefficient. 

43. The equalizer of claim 41, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 

R n= Z Jyf . +yf *Cj, where 

i = _ Kl V n-i 

yf and y~ respectively represent values of a neighboring sample y n .j in first 

and second dimensions, 

Ki, K 2 are numbers of samples adjacent to the candidate sample, and 
Cj is a coefficient. 

44. A receiver, comprising: 
a demodulator, 

a buffer memory in communication with the demodulator, 

a processor in communication with the demodulator, executing instructions that 
establish the following logical structures therein: 

a reliable symbol detector in communication with the buffer memory, 

an adaptation unit in communication with the reliable symbol detector, and 
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a symbol decoder unit in communication with the adaptation unit and the 
buffer memory, and 

a source decoder in communication with the equalizer. 

45. The receiver of claim 44, wherein the reliable symbol operates according to a 
method, comprising: 

calculating a reliability factor of a candidate sample from values of a plurality of 
samples proximate to the candidate sample, and 

if the reliability factor is less than a predetermined limit, designating the 
candidate sample as a reliable symbol. 

46. The receiver of claim 45, wherein the reliability factor R n of the candidate sample 
is given by: 



y n is the candidate sample, 

y n .j is a sample in proximity to the candidate sample, 

Ki, K 2 are numbers of samples adjacent to the candidate sample, and 

Cj is a coefficient. 

47. The receiver of claim 45, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 



y^ and y~ respectively represent values of a neighboring sample y n .j in first 

and second dimensions, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 
Cj is a coefficient. 

48. The receiver of claim 44, further comprising a second buffer memory in 
communication with the symbol decoder. ' 



K. 
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49. A transmission system comprising: 

a source that transmits data encoded as symbols, the symbols being selected 
from a high-order constellation, 

a destination that captures a signal representing the transmitted symbols having 
been corrupted by at least intersymbol interference, the destination: 
identifying reliable symbols from the captured samples, 
calculating channel effects based on the reliable symbols and samples 
proximate thereto, 

correcting other captured samples based on the channel effects. 

50. The method of claim 49, wherein reliable symbols are identified according to a 
method comprising: 

calculating a reliability factor of a candidate sample from values of a plurality of 
samples proximate to the candidate sample, and 

if the reliability factor is less than a predetermined limit, designating the 
candidate sample as a reliable symbol. 

51. The method of claim 50, wherein the reliability factor R n of the candidate sample 
is given by: 



y n is the candidate sample, 

y n .j is a sample in proximity to the candidate sample, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 

Cj is a coefficient. 

52. The method of claim 50, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 



R n = E|y n -i|-Ci, where 



K. 
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y? and y~ respectively represent values of a neighboring sample y n .j in first 

and second dimensions, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 
d is a coefficient. 

53. A computer readable medium having stored thereon instructions that, when 
executed, cause a processor to: 

calculate a reliability factor of a candidate sample from values of a plurality of 
samples proximate to the candidate sample, and 

if the reliability factor is less than a predetermined limit, designate the candidate 
sample as a reliable symbol. 

54. The method of claim 53, wherein the reliability factor R n of the candidate sample 
is given by: 



y n is the candidate sample, 

y n .j is a sample in proximity to the candidate sample, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 

Cj is a coefficient. 

55. The method of claim 53, wherein the reliability of a two-dimensional candidate 
sample y n is given by: 



y, 2 and y~ respectively represent values of a neighboring sample y n .j in first 

and second dimensions, 

Ki, K2 are numbers of samples adjacent to the candidate sample, and 
Cj is a coefficient. 
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56. A computer readable medium having stored thereon instructions that, when 
executed, cause a processor to: 

identify reliable symbols from a string of captured samples, 
calculate channel effects based on the reliable symbols and samples proximate 
thereto, 

correct the captured samples based on the channel effects. 

57. A data signal, generated according to the process of: 
identifying reliable symbols from a string of captured samples, 

calculating channel effects based on the reliable symbols and samples proximate 
thereto, 

estimating transmitted symbols from remaining captured samples based on the 
channel effects, and 

outputting the estimated symbols as the data signal.] 
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[75] ABSTRACT 



All practical communication channels impose some type of corruption on received 
data through inter-symbol interference (ISI). ISI corruption is particularly acute in high- 
order constellation transmission. Although ISI effects of high-order constellation 
transmission are very large on average, some symbols may be received that suffer 
relatively low levels of ISI. These symbols are "reliable symbols" and can be used to 
provide blind estimation of the ISI coefficients. Once the ISI effects of a channel are 
known, all captured signals may be corrected. 



379683_1.DOC 



Page 30 of 30 



11927/46001 







SIGNAL 






SOURCE 


X 


CORRUPTION 


Y 


DESTINATION 


HQ 




[ISO 




120 






130 








FIG. 1 









1QQ 



Fin, P DELAYED 
r 1 ^ * PATH 1, 

2QO 



DELAYED. 
PATH 2 




TX 



CALCULATE RELIABILITY 
FACTOR OF y n JfllQ 



IS RELIABILITY FACTOR < 
LIMIT? 

1Q2Q , 



■NO- 



y„ IS NOT A RELIABLE 
SYMBOL 1040 



YES 



y n IS A RELIABLE SYMBOL 
1Q3Q 



FIG. 4 

1QQQ 



FIG. 3 



(c) 



(d) 



15. 



13. 



(b) " 



-1 



(a) 



-1 



150 

(e) Q ^ 



+ + 



-3 1 -1i 



1i 3. 



140 



-5 



-7 



-1 1 



-13 



-15 



+ 


+ 


+ 




+ 


+ 


+ 


+ 




+ 


+ 


+ 


+ 


+ 


+ 


+ 




+ 


1 + 


+ 


+ 


+ 


+ 


+ 




+ 


+ 


ISP 
+ 


+ 


+ 




► 


^ 


















+ 


+ 

i 


+ 


+ I 


+ 


+ 


+ 


+ 


+ | 


+ + 
170 






+ 


+ 


+ 


+ 






+ 




+ 


+ 


+ 


+ 




+ 


+ 


+ 


+ 


+ 



FIG. 3 (f) 



. FIG. 3 (g) 



+ + + + 
190-1 



-(1.5) 



SAMPLE y n IS A RELIABLE 
SYMBOL 2QSQ 



-•YES- 



DOES i=0? 2Q6Q 



NO 

_L_ 



IS i>K,? 2QZQ 



NO 



IS R^? 2Q3Q 



YES 
_f_ 



SAMPLE y n IS NOT A 
RELIABLE SYMBOL 2Q4Q 



-YES»- 



INITIALIZE 2Q1Q 


► 


R n =R n +|y, vi | 2Q2Q 


[r-K,. R„=0] 




[R„=Rn + Ci*|y^D 








< 



INCREMENT i 2Q5Q 



FIG. 5 

2QOO 



NO 



i 

INCREMENT i 3Q4Q 



YES 




YES- 



SAMPLE y n IS A RELIABLE 
SYMBOL 2QZQ 



INITIALIZE 3Q1U 




(i=- 










— ► 



DOES i=0? 3Q5Q 



NO 



I 

NO 
_t_ 



IS i>K 2 ? 3QSQ 



NO 



FIG. 6 

3QOO 



IS |y n |>d ta ? SQ2Q 



YES 



SAMPLE y n IS NOT A 
RELIABLE SYMBOL 2Q3Q 



ADAPTATION 
UNIT 
22Q 



RELIABLE 
SYMBOL 
DETECTOR 
310 



FIG. 7 

3QO 



M 



DCN 



SYMBOL 
DETECTOR 33Q 



IDENTIFY RELIABLE 
SYMBOLS FROM CAPTURED 
SYMBOL SEQUENCE 3010 



„ ][ 

ESTIMATE ISI METRICS 
FROM RELIABLE SYMBOLS 
AND THEIR NEIGHBORS 3Q2Q 

FIG. 8 

3QQQ J 

DECODE CAPTURED 
SAMPLES 2Q2Q 



RELIABLE 
SYMBOL 
DETECTOR 43Q 



EN (aty RS ) f\Q m Q 
4QQ 



M, 



ISI 



SYMBOL 
DECODER 
410 



ADAPTATION 
UNIT 
420 



FIG. 10 

50Q 



DEMOD.Slfl 



CAPTURED 

SAMPLE 
BUFFER 522 



DECODED 
SYMBOL 
BUFFER 524 



PROGRAM 
INSTRUCTIONS 
52S 



MEMORY S2Q 



y n 



PROCESSOR 530 



RELIABLE 
SYMBOL 
DETECTOR 
532 



SYMBOL 
DECODER 
525 



I 



ADAPTATION 
UNIT 
534 



